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Introduction 


For the past several years, the Defense Advanced Research Projects 
Agency (DARPA), the military research and development agency tasked 
with maintaining U.S. military technological superiority, has engaged in 
research on direct neurological control of weapon systems.! Although 
international law does not create a per se prohibition on the use of these 
weapons, the potential misuse of such weapons radically challenges tradi- 
tional notions of criminal responsibility by effacing the distinction between 
thought and act.* This Note suggests that the development of such weap- 
ons requires a more expansive doctrine of command responsibility in order 
not to vitiate established legal principles regarding criminal accountability 
for war crimes. 

Part I of this Note examines DARPA’s Human Assisted Neural Devices 
(formerly Brain-Machine Interfaces) Program. It explores why DARPA 
regards these devices as a critical technology, how far DARPA has devel- 
oped the program, and where DARPA will deploy the initial uses of this 
technology, such as for the control of prosthetics of wounded soldiers and 
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the guidance of unmanned aerial vehicles (UAVs). In addition, Part I 
briefly surveys academic research in the field to determine how far the 
project has advanced. The classified nature of much of DARPA’s research 
precludes alternative approaches. 

Part II considers the use of neurological weapons in the context of 
international law. First, it investigates the current law on prohibited weap- 
ons and describes recent efforts to enlarge the scope of banned weapons. 
Part II then accounts for the historical difficulties in implementing prohibi- 
tions against the use of advanced technologies in war. Indeed, great dispar- 
ities exist between the law of warfare, which pronounces that the means of 
injuring enemies is not unlimited, and its implementation. Based on this 
examination of the current law of warfare, this section concludes that 
weapons employing brain-machine interfaces most likely do not violate 
international humanitarian law (IHL).3 

Nevertheless, weapons employing brain-machine interfaces likely will 
raise novel issues in the jurisprudence of war crimes. Part IIl examines 
these issues. First, Part III delineates the elements that prosecutors must 
establish in order to prove a war crime under international law. Second, it 
examines the difficulty in establishing a criterion for determining whether 
a soldier operating a brain-machine weapon possesses the requisite ele- 
ment of willfulness so as to justify holding him or her criminally responsi- 
ble for the deaths of non-combatants. Specifically, this section applies the 
analysis that the International Committee of the Red Cross offered to the 
drafters of the Rome Statute for determining what a prosecutor must prove 
to establish the mental element of a war crime.*+ Brain-machine interface 
weapons significantly complicate conventional approaches to the actus reus 
and mens rea requirements of criminal accountability. With regard to the 
actus reus element, Part III provides a brief overview of the state of cogni- 
tive neuroscience, particularly the experiments of Benjamin Libet, and sug- 
gests that the brain activity triggering the guidance of brain-machine 
weapons likely occurs before the will to move.> Next, it illustrates how the 
use of brain-machine interfaces will require answers to two unsettled issues 
regarding the act requirement: what is an act and is the act the object of 
criminal law or merely a necessary precondition for criminal liability to 
attach to a putative actor?© The use of such weapons, Part III argues, may 
force a re-examination of the rationale for the act requirement, a prerequi- 


3. See Protocol Additional to the Geneva Conventions of 12 August 1949, and 
Relating to the Protection of Victims of International Armed Conflicts art. 35.2, June 8, 
1977, 1125 U.N.T.S. 3 [hereinafter Additional Protocol 1 to the Geneva Conventions} (“It 
is prohibited to employ weapons, projectiles and material and methods of warfare of a 
nature to cause superfluous injury or unnecessary suffering.”); see also A. Koplow, Tan- 
gled Up in Khaki and Blue: Lethal and Non-Lethal Weapons in Recent Confrontations, 36 
Geo. J. INT'L L. 703, 745 (2005). 

4. Knut DorMANN, ELEMENTS OF WAR CRIMES UNDER THE ROME STATUTE OF THE 
INTERNATIONAL CRIMINAL COURT: SOURCES AND COMMENTARY 487-98 (2002). 

5. BENJAMIN LipeT, MIND Time: THE TEMPORAL FACTOR IN CONSCIOUSNESS 122-136 
(2004). 

6. Antony Duff, Action, the Act Requirement and Criminal Liability, in AGENCY AND 
Action 69, 72 (john Hyman & Helen Steward eds., 2004). 
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site justified as much for evidentiary as for fairness reasons.’ Part III then 
explores the problematic aspects of the mens rea element in the context of 
alleged war crimes committed using brain-machine interfaces, noting some 
of the problems that prosecutors may encounter in establishing either 
intent or criminal recklessness in situations where weapons that such inter- 
faces control respond before an actor possesses conscious intent. This sec- 
tion concludes that the issues raised are already lurking in criminal law 
due to new insights of cognitive neuroscience and postulates that the use of 
brain-machine interfaces may challenge foundational notions of free will 
that permeate criminal law.® 

Part IV asserts that the use of brain-machine interfaces to control 
weapons militates for an increased role for command responsibility. After 
providing a brief history of this doctrine, Part IV discusses criminal liabil- 
ity of superiors both under both international law and U.S. military law.? 
As weapon systems become increasingly autonomous, a more expansive 
notion of command responsibility is necessary to preserve criminal liabil- 
ity for war crimes. This broader conception should ensure that criminal 
liability attaches to those who approve the use of such weapons when they 
create an unreasonable risk of causing war crimes. Failure to expand the 
doctrine of command responsibility would allow advances in technology to 
undermine deeply established legal principles of international criminal 
law.1° 


I. DARPA’s Brain-Machine Interfaces and Human Assisted Neural 
Assistance Programs 


After the Soviet Union launched Sputnik, the first artificial satellite, on 
October 4, 1957, President Eisenhower approved the organization of the 
Advanced Research Projects Agency (ARPA) under the aegis of the Depart- 
ment of Defense.!! ARPA, subsequently renamed the Defense Advanced 
Research Projects Agency (DARPA),!2 originally served as an interim space 
program until the National Aeronautics and Space Administration (NASA) 
took over civilian space development.!? Since its inception, DARPA has 
served two principal functions: first, it performs advanced research to pre- 
vent developments in military technology from jeopardizing U.S. military 


7. See Wayne R. LaFave, CriminaL Law 303-04 (4th ed. 2003). 

8. Joshua Greene & Jonathan Cohen, For the Law, Neuroscience Changes Nothing 
and Everything, in Law AND THE BRAIN 207, 222-25 (Semir Zeki & Oliver R. Goodenough 
eds., 2006). 

9. Dep’r OF THE Army, FieLD MANUAL 27-10: THE LAw oF LAND WarrareE {J 501, 
507(b) (1956). 

10. Steve Featherstone, The Coming Robot Army: Introducing America’s Future Fight- 
ing Machines, Harper’s Mac., Feb. 2007, at 43, 49. 

11. ArtHur L. NorBerG ET AL., TRANSFORMING COMPUTER TECHNOLOGY: INFORMATION 
PROCESSING FOR THE PENTAGON: 1962-1986, at 5 (1996). 

12. ARPA/DARPA: The History of the Name, http://www.darpa.mil/body/ 
arpa_darpa.html (last visited Dec. 27, 2007). 

13. ALEx ROLAND & PHILIP SHIMAN, STRATEGIC CompuTING: DARPA AND THE QUEST 
FOR MACHINE INTELLIGENCE, 1983-1993, at 43 (2002). 
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predominance;!* second, it accelerates the technological transfer of emer- 
gent technologies into military deployment.!° 


Throughout its history, DARPA has had an impressive track record in 
militarizing its “blue sky”!® research. During the 1960s and 1970s, DARPA 
performed much of the initial research on the ballistic missile defense that 
the Army later developed. It also developed the stealth technologies 
employed in the F-117 Nighthawk tactical fighter and B-2 bomber.!” 
DARPA’s most significant research contributions, however, were the estab- 
lishment of ARPANET, a distributed packet-switched computer network 
designed to allow the Air Force to preserve control over its fleet of missiles 
and bombers in the event of a nuclear strike,!8 and the creation of 
ARPANET’s two dominant underlying protocols, known as Transmission 
Control Protocol and Internet Protocol (TCP/IP).!9 DARPA seeded this 
technology to the National Science Foundation, which created the NSFNET 
network.2° DARPA’s Transmission Control and Internet protocols became 
the basis of the modern internet when the U.S. government decommis- 
sioned NSFNET and commercialized its network on April 30, 1995.71 


One area of research that DARPA currently funds is the Human- 
Assisted Neural Devices Program, which evolved out of the Brain-Machine 
Interfaces program initiated in 2002.22 Despite a general shift in the 
agency’s priorities in the aftermath of 9/1123 and budgetary reductions in 


14. DARPA Over the Years, http://www.darpa.mil/body/overtheyears.html (last vis- 
ited Dec. 27, 2007). 

15. Evans, supra note 1, at 149. 

16. Richard N. Flint, Independent Research and Development Expenditures: A Study of 
the Government Contract as an Instrument of Public Policy, 29 Law & Contemp. Pross. 
619 (1964). “Basic or so-called ‘blue sky’ research is defined as the increasing of knowl- 
edge in science generally, but not any practical application thereof.” Id. 

17. DEFENSE ADVANCED RESEARCH Projects AGENCY, DARPA’s StRaTEGIC PLAN 7 
(2007), available at http://www.darpa.mil/body/pdf/DARPA2007Strategicplanfinal 
March14.pdf. 

18. Paui Dickson, SPUTNIK: THE SHOCK OF THE CENTURY 243-44 (Walker & Co. 
2007) (2001). 

19. See JOHN Davipson, AN INTRODUCTION TO TCP/IP 2-10 (2007). 

20. SHARON K. BLACK, TELECOMMUNICATIONS LAW IN THE INTERNET AGE 4 (2002). 

21. Id. at 5; see also Nat'l Sci. Found., Fact Sheet: A Brief History of NSF and the 
Internet (Aug. 13, 2003), http://www.nsf.gov/news/news_summ.jsp?cntn_id=103050. 

22. Evans, supra note 1, at 207. The impetus for creating the Brain Machine Inter- 
face Program was DARPA’s creation of “Roborat,” a rat with direct neural connections to 
a wireless brain modem. The movements of the rat could be controlled by remotely 
stimulating the somatosensory cortical area via the modem so as to mimic sensations to 
the rat’s whiskers and then rewarding the pleasure center of the rat’s brain, the medial 
forebrain bundle, by shocking the rat’s brain when it obeyed the operator’s control. See 
Eric EIlsENSTADT, BRAIN MACHINE INTERFACE 2 (2002), available at http://www.darpa.gov/ 
DARPATech2002/presentations/dso_pdf/speeches/EISENSTADT.pdf; see also Duncan 
Graham-Rowe, Say Hello to the RoboRat, New Scientist, May 4, 2002, at 6, 6-7. 

23. See John Markoff, Pentagon Redirects its Research Dollars, N.Y. Times, Apr. 2, 
2005, at C2. DARPA admitted the change in its priorities in April 2005, noting, inter 
alia, its new direction in advanced weapon system research as opposed to “blue sky” 
research. Id. 
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the wake of negative newspaper reports on its activities,2+ DARPA has con- 
tinued to develop this program and budgetary reductions in the wake of 
negative newspaper reports on its activities. DARPA has announced two 
goals for the Human Assisted Neural Devices Program (HANDP).?> First, it 
seeks to create “novel concepts that will improve warfighter performance 
on the battlefield.”2© Second, it attempts to improve prosthetic technology 
for severely injured veterans.*’ 

DARPA has reached important milestones in both aspects of its 
Human Assisted Neural Devices Program. By 2000, technology developed 
at Duke University for HANDP had reached the state where a monkey with 
invasive brain sensors could guide a remote robotic arm linked 950 kilome- 
ters away via the Internet,?® presaging the development of remotely piloted 
weapons.29 On March 6, 2007, the U.S. Patent and Trademark Office 
granted a patent entitled “Apparatus for acquiring and transmitting neural 


24. DARPA’s funding of the Information Awareness Office (IAO), which John 
Poindexter, the former National Security Advisor convicted for his role in the 1986 Iran- 
Contra guns-for-hostages deal, ran, provoked outrage from civil libertarians after the 
New York Times reported its existence in 2002. See John Markoff, Chief Takes over at 
Agency to Thwart Attacks on U.S., N.Y. Times, Feb. 13, 2002, at A27; see also William 
Safire, You Are a Suspect, N.Y. Times, Nov. 14, 2002, at A35. One of the most controver- 
sial projects under [AO was Futures Markets Applied to Prediction (FutureMap), which 
contained a component called “Policy Analysis Market,” a “terrorism futures market” 
that sought to increase the accuracy of military predictions by creating efficient capital 
markets in which participants, potentially including the actors themselves, could bet on 
the likelihood of events such as catastrophic terrorist attacks and political assassina- 
tions. See JAMES SUROWIECKI, THE WisDOM OF Crowps: Wry THE MANY ARE SMARTER 
THAN THE FEw AND How COLLECTIVE WispDoM SHAPES BUSINESS, ECONOMIES, SOCIETIES, AND 
Nations 79-83 (2004) (arguing the potential effectiveness of such a system), see also 
DEFENSE ADVANCED RESEARCH Projects AGENCY, REPORT TO CONGRESS REGARDING THE TER- 
RORISM INFORMATION AWARENESS PROGRAM B-8-B-9 (2003), available at http:// 
www.eff.org/Privacy/TIA/TlA-report.pdf. Ultimately, Congress ended funding in 2003 
for the IAO, subsequently renamed the Terrorism Information Awareness Program, 
when it passed its defense appropriations bill. See Department of Defense Appropria- 
tions Act, Pub. L. No. 108-87, § 8131, 117 Stat. 1054, 1102 (2003). Although the Brain- 
Machine Interface program was not part of IAO, it also lost funding as part of the reeval- 
uation of DARPA’s mission. See Gareth Cook, Defending DARPA: The Government's 
Strangest Research Might Be its Best, Boston Giose, Aug. 3, 2003, at El (arguing for 
maintenance of funding on the Brain Machine Interface program by distinguishing it 
from FutureMap). 

25. Human-Assisted Neural Devices, http://www.darpa.mil/dso/thrusts/bio/ 
restbio_tech/hand/index.htm (last visited Jan. 14, 2008). 

26. Dep't of DEFENSE, RDT@E Bupcet ITEM JUSTIFICATION SHEET (R-2 Exuisit) 11 
(2005), available at http://www.dtic.mil/descriptivesum/Y2006/DARPA/0601101E.pdf. 

27. Dep't oF DEFENSE, RDT&E Bupcet ITEM JUSTIFICATION SHEET (R-2 ExnisiT) 8-9 
(2007), available at http://www.dtic.mil/descriptivesum/Y2008/DARPA/0601101E.pdf. 

28. Johann Wessberg et al., Real-Time Prediction of Hand Trajectory by Ensembles of 
Cortical Neurons in Primates, 408 Nature 361, 361-65 (2000); see also Mikhail A. 
Lebedev et al., Cortical Ensemble Adaptation to Represent Velocity of an Artificial Actuator 
Controlled by a Brain-Machine Interface, 25 J. Neurosci. 4681, 4681-93 (2005), Eliza- 
beth A. Thomson, Monkey Controls Robot Arm Using Brain Signals Sent Over Internet, 
MIT Tecu Tatk, Dec. 6, 2000, at 1. 

29. Gregory T. Huang, Mind Machine Merger: Devices that Connect the Brain with 
Computers Could Lead to Mind-Controlled Robots, Repair Neurological Disorders, and Even 
Improve Memory, Tecu. Rev., May/June 2003, at 38, 39. 
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signals and related methods” jointly to Duke and DARPA.3° The patent 
application discloses that uses for the technology “include but are not lim- 
ited to weapons or weapon systems, robots or robot systems.”3! Applica- 
tion of this technology to prosthetics has already progressed into human 
trials.32_ In 2006, a tetraplegic human with a rudimentary microelectrode 
cortical implant demonstrated the feasibility of this technology by manipu- 
lating a simulated computer, a television, and a robotic arm.77 DARPA 
researchers have started to commercialize this technology. For instance, a 
former DARPA reseacher now heads Cyberkinetics, a private company that 
is currently testing “BrainGate,” a neural interface designed to permit 
severely motor-impaired individuals to communicate their thoughts 
directly to a computer.3* 

HANDP represents the intersection of two lines of technological devel- 
opment long championed at DARPA.*> The first is tighter coupling 
between humans and computers, a direction of research that began in early 
1970s when the federal government sponsored research in the Brain-Com- 
puter Interfaces Project at the University of California, Los Angeles.36 The 
second is increased automation in weapon systems.?” In 1960, J.C.R. Lick- 
lider, a psychologist who later served as Director of DARPA, proposed a 
“man-computer symbiosis” that would serve during an interim period 
before an “intimate association” between man and computer could yield 
computers with true artificial intelligence.7® Licklider noted that the reali- 
ties of modern warfare would require increasingly quick tactical decisions, 
necessitating a union of the unmatched serial processing capabilities of 
computer technology and the massively parallel processing that the struc- 
ture of the human brain facilitates.39 In Licklider’s view, people would 
play an important gap-filling role “when the computer has no mode or rou- 


30. Apparatus for Acquiring and Transmitting Neural Signals and Related Methods, 
U.S. Patent No. 7,187,968 (filed Oct. 23, 2003) (issued March 6, 2007). 

31. Id. at col. 8, 1.36-38. 

32. Allison Abbot, Neuroprosthetics: In Search of the Sixth Sense, 442 Nature 125, 
125-26 (2006). 

33. Leigh R. Hochberg et al., Neuronal Ensemble Control of Prosthetic Devices by a 
Human with Tetraplegia, 442 Nature 164, 164-71 (2006). 

34. Cyberkinetics Brain Gate Clinical Trials, http://www.cyberkineticsinc.com/con- 
tent/clinicaltrials/braingate_trials.jsp (last visited Dec. 27, 2007). Academic researchers 
are working on direct neural interfaces for speech synthesis software. See Paralyzed 
Man’s Mind is ‘Read,’ BBC News, Nov. 15, 2007, http://news.bbc.co.uk/2/hi/health/ 
7094526.stm (last visited Dec. 27, 2007) (researchers claiming 80% success rate in 
decoding sound in paralyzed man’s brain). Commercial firms, such as Microsoft, have 
engaged in related research. See Using Electroencephalograph Signals for Task Classifi- 
cation and Activity Recognition, U.S. Patent No. 20,070,185,697 (filed Feb. 7, 2006). 

35. Human-Assisted Neural Devices, http://www.darpa.mil/dso/thrusts/bio/ 
restbio_tech/hand/index.htm (last visited Jan. 14, 2008). 

36. Sixto Ortiz Jr., Brain-Computer Interfaces: Where Human and Machine Meet, Com- 
PUTER, Jan. 2007, at 17, 17. 

37. See generally J.C.R. Licklider, Man-Computer Symbiosis, HFE-1 IEEE TRansac- 
TIONS ON Hum. Factors IN ELEctronics 4, 4-11 (1960). 

38. Id. at 4. 

39. See id. at 14. 
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tine that is applicable in a particular circumstance.”4° Nevertheless, Lick- 
lider believed that “man-machine symbiosis” would not likely prove “the 
ultimate paradigm for complex technological systems” because advances in 
artificial intelligence might eventually render humans’ role superfluous in 
tactical warfare decisions.*4 


Licklider proved prescient with respect to the systemic challenges that 
modern warfare presents. He foresaw that increasing automation would 
create a continuum of human involvement, as man would need to be “in 
the loop” before he could delegate his command to expert artificial intelli- 
gence systems, which link particular algorithms with the known facts of a 
specific problem domain to make tactical military decisions.*? Irrespective 
of the need for increased mind-machine linkage for such military decision- 
making, the complexity of military technology, particularly that associated 
with turbojet aviation and missile design, has necessitated increased auto- 
mation due to the limitations of human physiology in the context of flight, 
an automation now achieved largely through avionics.*> Since the inner 
ear lacks the capacity to distinguish between accelerating into a turn and 
slowing down away from it—a sensory deficit that has led many pilots to 
become disoriented and crash after performing a “graveyard spiral’4+— 
early pioneers of aviation recognized the need to augment human abilities 
by mechanical means.*? These inventors introduced technologies ranging 
from gyroscopic stabilizers, which were first introduced in 1891, to auto- 
matic stabilizers allowing for hands-free flight, which Orville Wright 
demonstrated in 1913.*© The development of faster engines and long-dis- 
tance flight accelerated the trend toward fuller automation after World War 
II, with new systems created for navigation, autopilot, and flight manage- 
ment.*” Given that modern civilian aircrafts often require well over one 
hundred separate computer systems,*® military avionics comprise some of 
the most sophisticated system engineering. Engineers have had to address 
numerous problems inherent in flight,*? including how to navigate accu- 
rately over long distances, how to create designs that can sustain the 
stresses resulting from unpredictable weather, how to compensate for the 
instability of supersonic flight, how to create systems that allow pilots to 
evade threats, and how to prevent pilots from being overwhelmed with sen- 


40. Id. at 7. 

41. Id. at 2. 

42. Id. at 6-7. 

43. Cuares E. BILLINGS, HUMAN-CENTERED AVIATION AUTOMATION: PRINCIPLES AND 
GuIDELines 13-14 (1996), available at http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa. 
gov/19960016374_1996036711.pdf. ; 

44. WILLIAM LANGEWIESCHE, INSIDE THE Sky: A MEDITATION ON FLIGHT 67, 85-87 
(1999). 

45. See BiLLincs, supra note 43, at 15. 

46. Cuarves E. BILLINGS, HUMAN-CENTERED AIRCRAFT AUTOMATION: A CONCEPT AND 
GuIpELines 8 (1991), available at http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/ 
19910022821_1991022821 pdf. 

47. See id. at 17-21. 

48. Id. at 18. 

49. See id. at 17-46. 
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sory data that might cause them to make poor targeting decisions during 
periods of extreme stress and time pressure.*° Compounding the diffi- 
culty for engineers is the fact that automation often breaks down in an 
erratic manner.>! As a result, engineers have understood the need to keep 
humans, who have a unique ability to respond to unanticipated conditions, 
involved in the decision-making process.>? 

At the same time, engineers have recognized the need to develop paral- 
lel technologies that sometimes automate systems beyond human con- 
trol.>3 There are two primary reasons for these parallel technologies. First, 
human limitations may require computer systems to override human con- 
trol in certain situations.** For instance, the maneuvers necessary to avoid 
incoming missiles may require a computer to take control of a plane 
because the gravitational forces experienced during successful evasion 
may cause humans to lose consciousness.°> Second, the cognitive load 
imposed on operators under stress may overwhelm their decision-making 
ability, requiring expert systems to prioritize tasks for humans automati- 
cally and to take over for them when they exhibit diminished capacity.>© 

Despite the difficulties of automating aerial weapons, military plan- 
ners in the United States have recognized that autonomous weapons will be 
increasingly important in future combat missions.°’ First, autonomous 
weapons serve as a significant force multiplier.°® One soldier can now 
operate several unmanned aerial vehicles (UAVs) at the same time.°9 Fur- 
ther, the Department of Defense’s roadmap for the technology anticipates 
UAVs with the capacity to swarm within ten years.©° Second, autonomous 
weapons allow soldiers to stay within U.S. borders while fighting wars.°! 


50. See id. 

51. See Leslie Lamport et al., The Byzantine Generals Problem, 4 ACM TRANSACTIONS 
ON PROGRAMMING LANGUAGES & SysTEMS 382, 382-401 (1982). 

52. BILLINGS, supra note 43, at 12. 

53. See Mark Stefik, Strategic Computing at DARPA: Overview and Assessment, 28 
Comm. ACM 690, 692 (1985). 

54. Id. 

55. Id. 

56. In the mid-1980s, DARPA had a program called “The Pilot’s Associate,” which 
was designed to create robotic helpers for pilots. See id. at 692. Much of this technology 
has been used in DARPA’s current “Augmented Cognition” program, which is closely 
aligned with the HANDP. See Improving Warfighter Information Intake Under Stress 
(AugCog), http://www.darpa.mil/DSO/thrusts/trainhu/warfighter/index.htm (last vis- 
ited Jan. 14, 2008); see also Misha Pavel et al., Augmented Cognition: Allocation of Atten- 
tion, in PROCEEDINGS OF THE 36TH ANNUAL HAwall INTERNATIONAL CONFERENCE ON SYSTEM 
Sciences (2002). 

57. See Orrice OF Sec’y oF Der., UNMANNED AIRCRAFT Systems Roapmap: 2005-2030, 
at i (2005), available at http://www.acq.osd.mil/usd/Roadmap%20Final2.pdf. 

58. Id. at J-8. 

59. Control systems for simultaneous control of multiple UAVs are already in testing. 
See Raytheon Tests Multiple UAV Control System, UniteD Press INTL, Apr. 10, 2006, http:// 
www.upi.com/Security_Terrorism/Analysis/2006/04/10/raytheon_tests_multiple_uav_ 
control_system/1509/. 

60. See Orrice oF Sec’y or Der., supra note 57, at D9-10. 

61. The Predator UAVs operating in Afghanistan are controlled via satellite from Nel- 
lis Air Force Base in Nevada. See Brent Sadler, In the Sights of a Joystick Killing Machine, 
CNN, June 9, 2006, http://www.cnn.com/2006/WORLD/asiapcf/06/09/sadler. 
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This serves: (1) a political function, because it requires fewer deployed 
soldiers and obviates the need for risky pilot rescue missions,°? (2) a legal 
function, because it creates a jurisdictional hurdle for the prosecution of 
soldiers by courts such as the International Criminal Court (ICC),63 and 
(3) a technological function, because it may prevent the transfer of sensitive 
military technology, as engineers can give these weapons the capacity to 
self-destruct before enemies can capture and reverse-engineer them.6* 
Although DARPA has performed research and development on nearly 
autonomous “fire and forget” weapon systems,®° present limitations on 
technology, the military’s general distrust of completely autonomous sys- 
tems, and persistent questions on the legality of such systems has led 
DAPRA to continue to research transitional technologies, such as those 
associated with its Human Assisted Neural Devices research.©© In 1985, 
DAPRA began combining some of its technologies in its Smart Weapons 
Program,°’ which sought to develop a novel technology for deploying 


predator.btsc/index.html (last visited Dec. 27, 2007). The U.S. Air Force flies its Global 
Hawk UAVs in Iraq from Beale Air Force Base in California. See CNN Sunday Morning 
(CNN television broadcast Nov. 26, 2006), available at http://transcripts.cnn.com/ 
TRANSCRIPTS/0611/26/sm.01.html. 

62. The political fallout from the broadcast of Black Hawk helicopter pilots crashing 
under hostile fire while supporting the U.N. humanitarian mission, UNOSOM Il, in 
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unmanned weapons characterized not only by their precision but also by 
their capacity to linger over an area and accurately target and launch weap- 
ons on their own.®® These weapons have yet to move past the research and 
development stage, but the Department of Defense projects that it will field 
an unmanned aerial vehicle with full automation by 2015.°9 

The Department of Defense anticipates that future unmanned aerial 
vehicles will be linked to a pilot’s neuromuscular system so as to transform 
the pilot “from seeing the plane to being the plane.””° Paradoxically, weap- 
ons that use this transitional brain-interface technology may present more 
difficult legal issues than those that are fully autonomous “smart” weap- 
ons. Autonomous weapons more clearly implicate existing notions of com- 
mand responsibility than biologically linked “wetware” systems, a point 
examined in Part IV of this Note. 


Il. The Use of Brain-Machine Interfaces in the Context of 
International Criminal Law 


The development and use of weapons coupled with brain-machine 
interfaces most likely does not violate international criminal law. Per se 
prohibitions on the use of certain types of weapons may occur if either 
treaties or custom proscribe their use in armed conflict.”! Even if no such 
prohibition exists, certain uses of novel instrumentalities of warfare may 
still constitute war crimes under international treaties or customary law in 
certain conditions.’ 

Although nations have attempted to regulate the law of war throughout 
history, the first attempt at creating a binding international treaty to ban 
the use of a particular weapon was the 1868 St. Petersburg Declaration 
Renouncing the Use, in Time of War, of Explosive Projectiles Under 400 
Grammes Weight.’? International treaties have proscribed the use of other 
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weapons, including asphyxiating gases,’* expanding bullets,’> air-deliv- 
ered incendiary weapons,’® landmines,’” fragmentary weapons that leave 
shrapnel that surgeons cannot readily detect,”® and laser weapons 
designed to blind.?9 

The U.S. Department of Defense requires that all weapons conform to 
international law.8° Pursuant to its treaty obligations,®! the United States 
has recognized only three weapons that are per se illegal to use in war: 
poison, chemical weapons, and exploding (dumdum) bullets.82 Even 
though brain-machine interface weapons do not fall within these prohibi- 
tions, they potentially fall within the ambit of Article 23(e) of the Hague 
Convention. Article 23(e) prohibits state parties from “employ[ing] arms, 
projectiles, or materials calculated to cause unnecessary suffering.”83 
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Additional Protocol I of the Geneva Conventions may also require that the 
United States impose certain restrictions on the use of brain-machine inter- 
face weapons, as the Department of Defense has recognized that certain 
aspects of the Protocol have attained the status of customary international 
law.8+ Under Article 35 of Additional Protocol I, parties to an armed con- 
flict do not have unlimited discretion in their choice of weapons and must 
not use weapons that will “cause superfluous injury or unnecessary suffer- 
ing” or that “are intended, or may be expected to cause widespread, long- 
term and severe damage to the natural environment.”®> Under Article 36 
of Additional Protocol I, state parties to the Protocol must assess, “[i]n the 
study, development, acquisition or adoption of a new weapon . . . whether 
its employment would, in some or all circumstances, be prohibited” under 
the Protocol or international laws applicable to the contracting state.8° 
The Rome Statute contains similar provisions that might apply to U.S. ser- 
vicemen who find themselves under the jurisdiction of the International 
Criminal Court.8” 


Under international law, the use of brain-machine interface weapons 
must also comply with the customary law of war. Many treaties, including 
treaties that the United States has ratified, explicitly recognize the role that 
customary law plays in circumscribing the range of permissible weap- 
ons.88 For example, paragraph 8 of the preamble to the 1907 Hague Con- 
vention IV, known as the “Martens Clause,”8° requires state parties to 
ensure that “the inhabitants and belligerents remain under the protection 
and governance of the principles of the law of nations, derived from the 
usages established among civilized peoples, from the laws of humanity, 
and from the dictates of public conscience.”°° Since the seventeenth cen- 
tury, the general customary law has been that states may employ only 
those weapons that military necessity justifies during war.9! If the cause 
of the war is deemed just, however, states have a great deal of latitude with 
respect to their choice of weapons and to the manner in which they employ 
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them.?? As Hugo Grotius recognized, even if the principle of military justi- 
fies the means and weapons employed, i.e. they are necessary to overcome 
an armed enemy, a number of factors, primarily necessity and proportion- 
ality, still constrain the right of states to use such weapons.9? Since World 
War II, customary international law has imported many of these factors via 
instruments developed under international human rights (IHR) law, a 
domain of law that has largely developed in parallel with international 
humanitarian law (IHL).9* 

Whether the Martens Clause binds parties that have refused to ratify 
weapons’ treaties remains a disputed area of law.9> In 1996, the Interna- 
tional Court of Justice (ICJ) issued an advisory opinion on the legality of 
nuclear weapons that relied upon the Martens Clause.9© The Russian Fed- 
eration argued that the ratification of the Geneva Conventions rendered the 
Martens Clause superfluous.°” Great Britain, however, maintained that 
the Martens Clause still possesses independent force, although it argued 
that it did not create a per se prohibition on the use of nuclear weapons.?8 
Even if the Martens Clause does restrict the choice of weapons for all 
nations, exactly which weapons fall within its purview is also contested.99 
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Based on a ten-year study, the International Committee of the Red Cross 
(ICRC) determined that the Martens Clause precluded weapons including 
poison, biological and chemical weapons, expanding and exploding bul- 
lets, weapons using primarily non-detectible fragments to injure, booby 
traps, and blinding laser weapons.!°° The Red Cross also found severe 
limitations on the use of landmines, incendiary weapons, and nuclear 
weapons.!°! Some international humanitarian law scholars, however, have 
contested the ICRC’s conclusions. These scholars have noted a lack of case 
law on weapons, such as blinding laser weapons.!©2 Further, they have 
pointed to recent national court decisions upholding the legality of some 
weapons that the Red Cross found heavily restricted, such as flechette 
shells used in the Gaza Strip!° and cluster bombs employed in Zagreb.!°* 
Finally, they have emphasized denials of customary military prohibitions 
on the use of incendiary weapons, such as American and British military 
officials’ affirmation of the legality of the use of white phosphorous in Fal- 
lujah, Iraq.19> 

Thus, ex ante, even though “the right of the Parties to the conflict to 
choose methods or means of warfare is not unlimited,”!°° international 
law most likely does not prohibit brain-machine interfaced weapons. Nev- 
ertheless, fully autonomous weapons may lack the ability to distinguish 
between legitimate combatants and people who have surrendered and 
thereby gained certain rights as non-combatants.!©7 Several reasons war- 
rant drawing this conclusion. First, in the majority of cases, brain-machine 
interface weapons may provide an unparalleled degree of precision in dis- 
criminating between legitimate and prohibited targets under international 
humanitarian law.1°8 During World War Il, the allied forces deployed 
crude unmanned guided missiles,!°° while reconnaissance planes 
equipped with Maverick missiles flew in the Vietnam War.!!° Given that 
these weapons did not lead to findings of violations of international 
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humanitarian law, it is unlikely that the use of more precise weapons 
would give rise to the presumption that their deployment violated interna- 
tional humanitarian law. In fact, unmanned aerial vehicles piloted via 
brain-machine interfaces could prove more accurate in their targeting than 
even present-day non-interfaced incarnations of these weapons.!!! The 
current generation of UAVs employs conventional guidance systems, and 
some of them have been armed and installed with Hellfire missiles, mis- 
siles used to attack tanks and bunkers.!!2 The United States has carried 
out tactical strikes with these drones to target particular individuals, 
including Bin Laden and Mullah Mohammed Omar in Afghanistan,!!> and 
the Pentagon claims that use of these drones has reduced military and civil- 
ian casualties.1!+ Because military forces have used these weapons in their 
prior incarnations for nearly one hundred years without challenges to their 
legality under international law, they seem to have achieved general accept- 
ance under international humanitarian law as legitimate weapons for use 
in combat missions. Furthermore, given that these drones have served in 
reconnaissance operations during humanitarian missions in Kosovo,!!5 it 
seems unlikely that international humanitarian law will prohibit their use, 
at least ex ante. In the future, international humanitarian law, however, 
could theoretically distinguish between their use for reconnaissance and 
military strike purposes. 


Second, the United States may use such weapons domestically in 
homeland operations.!!© This factor may be used to assess their legality 
because the domestic use of UAVs suggests that they are not inherently 
indiscriminate; the United States presumptively would not jeopardize its 
own citizens by using indiscriminate or disproportionate weapons. 


Third, international law has proven extremely solicitous about con- 
demning aerial bombardment due to its clear military utility in modern 
warfare. Although the 1899 and 1907 Hague Declarations prohibited the 
use of projectiles launched from balloons, no formal treaty either expressly 
or implicitly regulates air combat.'!” Moreover, those prohibitions that 
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nations have proposed, such as the 1923 Hague Rules of Aerial Warfare,11® 
have never been ratified.1!9 Despite the enormous number of civilian casu- 
alties of aerial bombardment in Dresden, Tokyo, London, Hiroshima, and 
Nagasaki during World War II, no defendant was ever prosecuted for war 
crimes in connection with this method of warfare.!*° In contrast to the 
body of law that has emerged recently to protect non-combatants and to 
reinforce the principles of international human rights law,!2! international 
humanitarian law during World War II was more concerned with protect- 
ing soldiers than civilians.!2* Thus, it may not prove too surprising that 
the Nuremberg Tribunal’s only trial associated with “indiscriminate bomb- 
ing” involved the prosecution of a Japanese judge for convicting two Ameri- 
can pilots for fire-bombing Japanese cities.!23 Due to the general paucity 
of international law prohibiting the use of new weapons,!2* it seems 
unlikely that the use of brain-interface weapons would fail to survive legal 
scrutiny under international humanitarian law as long as remote pilots 
could control these weapons with a high degree of accuracy. 


Ill. Novel Issues of Law That Brain-Machine Interfaces Raise in the 
Context of International Criminal Law 


Even if the use of a weapon such as a brain-machine interface guided 
drone or missile is not prohibited per se under international criminal law, 
criminal liability may still attach to soldiers who use the weapons to com- 
mit certain crimes under both domestic and international law. The War 
Crimes Act of 1996 criminalizes, inter alia, grave breaches of the Geneva 
Conventions and the Additional Protocols to which the United States is a 
party. It also criminalizes violations of Articles 23, 25, 27, and 28 of the 

‘Annex to Hague Convention IV.!2> Under the Geneva Conventions, “will- 
ful killing” constitutes a war crime.1?© Moreover, under the specific Arti- 
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cles of the Hague Convention enumerated in the War Crimes Act, acts 
constituting war crimes include killing enemies who have capitulated, 
attacking undefended towns, or conducting sieges or bombardments on 
hospitals.!27 Servicemen may also fall under the war crimes jurisdiction 
that the International Criminal Court claims.!28 Under the Rome Statute, 
a soldier who kills one or more persons protected under the Geneva Con- 
ventions during an international armed conflict may be tried for war 
crimes before the International Criminal Court.!?9 


In addition, violations under the customary laws of war and under 
international humanitarian law may also lead to criminal liability. Many of 
the accused war criminals tried in the aftermath of World War II were 
found guilty of having transgressed customary law,!3° such as the wide- 
spread prohibition against murder, a war crime explicitly recognized under 
the Charter of the International Military Tribunal at Nuremberg.!3! More 
recently, the International Criminal Tribunal for the Former Yugoslavia 
held that murder in an international conflict would qualify as a war crime 
under the “willful killing” criterion. The Tribunal also found that acts or 
omissions that violate existing treaties or customary laws of war were war 
crimes.!32_ Many international human rights conventions, such as the 
International Covenant on Civil and Political Rights and the American Con- 
vention on Human Rights, have explicitly established that the right to life is 
non-derogable,!33 and case law has established the existence of a related 
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peremptory norm that prohibits murder.!3+4 

Because prosecuting a drone pilot who had used a brain-machine 
interfaced weapon to kill a civilian or non-combatant for war crimes would 
require the prosecutor to prove that he or she had violated existing laws 
criminalizing “willful killing,” the potential liability of these pilots under 
international humanitarian law is unclear. Under the principle of legality 
enshrined in both the instruments and the customs of international crimi- 
nal law, courts do not have the power to try an individual accused of a 
criminal offense if the act or omission for which he or she has been 
charged has not previously been established as illegal.!35 To narrow the 
scope of the examination, this Note will analyze the potential problems that 
could arise as a result of alleged war crimes that implicate the use of such a 
weapon by applying the relevant provisions of the Rome Statute. Other 
tribunals would likely apply similar rules. 

Under the Rome Statute, the war crime of willful killing requires that 
the prosecutor prove that the defendant killed or caused the death of one or 
more people whom he or she knew was protected under at least one of the 
Geneva Conventions during an international war.!3© Furthermore, the ele- 
ments of Article 8 war crimes, such as willful killing, must be interpreted 
within the framework of international law.!37 Under recent international 
criminal tribunal case law,!3® individual accountability for the crime of 
willful killing requires that the prosecutor prove both the actus reus, that 
the death resulted from a voluntary act or willful omission,}39 and the 
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mens rea, that the defendant possessed a culpable state of mind at the time 
of the killing.14° The International Committee for the Red Cross has found 
that these principles accord with all modern domestic criminal legal sys- 
tems.!41 The Rome Statute requires the presumption of the defendant's 
innocence unless all of the elements of the crime is satisfied with respect to 
the requisite mental state defined in the statute.!47 

In the absence of case law under the Rome Statute, it is unclear 
whether the court will require an independent finding that the actus reus 
element is satisfied.!43 If it does, it is still unclear how the International 
Criminal Court will define the element and its role in assessing the defen- 
dant’s guilt.144 If criminal intent implicates volitional action, as some 
scholars have argued, the court may subsume the principle within the con- 
cept of mens rea, or it may define actus reus as a voluntary or conscious 
act.145 Such a definition would create a separate requirement for criminal 
culpability since theoretically the actus reus for the crime could exist when 
the requisite mens rea does not.146 

Traditionally, two separate justifications exist for requiring that a 
court find the actus reus element satisfied before imposing criminal liabil- 
ity. The first is based on evidentiary concerns; the other, fairness con- 
cerns.!#” With respect to the evidentiary justification, the act requirement 
could have been required because there has been no means to prove con- 
clusively what an actor was thinking at the moment that he or she commit- 
ted an offense, making any attempt to criminalize bad thoughts futile due 
to a lack of evidence.!4® As for the fairness justification, Anglo-American 
notions of criminal justice preclude punishment in the absence of an 
attendant social harm and, therefore, Anglo-American criminal law has 
refused to criminalize someone solely for his or her bad thoughts or “for 
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being a poor species of humanity.”!49 This fairness concern reflects the 
awareness that highly ethical actions may sometimes appear otherwise and 
that punishing bad thoughts might have perverse social consequences.!>° 
Kantian deontological ethics, for instance, recognizes that a person who 
regularly thinks bad thoughts and yet does good deeds may actually prove 
the highest moral exemplar.'5!_ Such a person obeys ethical duties not 
because nature has endowed him or her with the gift of being virtuous, but 
rather because he or she chooses to do right out of a sense of duty notwith- 
standing his or her awareness that he or she possesses the freedom to do 
otherwise.!°2 Punishing such a person would not serve a rehabilitative or 
retributive purpose and, thus, criminal law has refused to stigmatize those 
who contemplate bad deeds but do not actually perform them.!53 


The requirement of a voluntary act seems to have attained the status 
of customary law. Anglo-American law has long required proof of actus 
reus as a sine qua non for attaching criminal liability to an actor.!>* In the 
United States, any domestic statute creating a crime without incorporating 
the requirement will not pass constitutional scrutiny.1>> Similarly, in civil 
law countries, the voluntary act element exists as a necessary condition for 
imposing criminal liability.15° In France, for instance, the prosecutor must 
prove both l’élément matériel, which corresponds to actus reus, and 
élément moral, which corresponds to mens rea.19’ Further, under Islamic 
law, criminal sanctions depend on finding volitional acts; killings that 
result from unconscious acts are treated as homicide by mistake (qatl al- 
khata’), a crime qualitatively different from and less severely punished 
than willful murder (qatl al-’amd), a transgression that follows from inten- 
tional acts.1°8 

Resolving the issue of whether a pilot remotely connected by a brain- 
machine interfaced UAV could incur criminal liability for having killed a 
person that the Geneva Conventions protect would prove particularly prob- 
lematic because of the uncertain status of the role that the actus reus 
requirement plays in determining criminal responsibility.1°° Before the 
existence of this type of weapons system, courts had no occasion to resolve 
whether the condition exists merely because of the evidentiary impossibil- 
ity of proving a thought crime or because the requirement in fact possesses 
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an independent significance.1®° In cases where pilots using brain-machine 
interface weapons are charged with war crimes, however, the issue may 
prove dispositive. The pilot may have fired his weapon without having 
made either a conscious or voluntary act before the ensuing deaths 
occurred.!61 

One of the justifications for employing a brain-machine interface is 
that the human brain can perform image calculations in parallel and can 
thus recognize items, such as targets, and classify them in 200 millisec- 
onds,!®? a rate orders of magnitude faster than computers can perform 
such operations.'®3 In fact, the image processing occurs faster than the 
subject can become conscious of what he or she sees.!®* Studies of 
patients with damage to the striate cortex possess what neuropsychologists 
term “blindsight,” an ability to predict accurately where objects are posi- 
tioned, even when they are placed outside these patients’ field of vision.!®° 
The existence of this ability suggests the operation of an unconscious vis- 
ual perception system in the human brain.1©° These blindsight patients 
often exhibit “levels of accuracy well beyond the performance of normal 
observers making judgments close to the threshold of awareness,”!®7 par- 
ticularly with regard to locating ‘unseen’ objects.1°° The speed of visual 
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recognition varies depending on its degree of the perceived object’s multi- 
valence; ambiguous objects take more time to process.!©9 If neural- 
interfaced weapons were designed to fire at the time of recognition rather 
than after the disambiguation process, a process that would likely need to 
occur for the pilot to differentiate between combatants and protected per- 
sons,!7° the pilot firing them presumably would lack criminal accountabil- 
ity for the act implicit in willful killing. Because of the way brain-interfaced 
weapons may interrupt the biology of consciousness, reasonable doubt 
may exist as to whether an actor performed a conscious act in the event of 
a contested incident. 

The use of machine interfaces may also lead to problematic results in 
the context of determining whether or not a volitional act took place.!7! 
The recognition of movement and motion planning register different elec- 
trical patterns of brain activity, and brain-machine interface studies rely on 
discriminating between different types of neural activity.!72 Advances in 
neuro-imaging now make it possible to use computers to make increasingly 
accurate predictions about what a subject will to do before he or she actu- 
ally does it. A recent journal article reported that a computer can make a 
correct prediction of what a subject will do 71% of the time by analyzing 
the electrical activity generated by the subject’s medial prefrontal cortex 
when he or she makes a decision.!73 Theoretically, a brain-machine inter- 
face weapon could fire a weapon based on such a predictive response, 
thereby making it uncertain whether or not a volitional act actually took 
place.'7* Even without the use of the predictive capability of computers or 
without the problem of disambiguation, such a system could target weap- 
ons at the time the individual first evinced neural activity in his or her 
motor cortex, a measurement known as a Bereitschaftpotential, or readiness 
potential. Bereitschafpotential precedes volitional motor activity by up to 
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one second.!75 Such a probabilistic system theoretically would allow com- 
puters to have more time to calculate guidance trajectories.17° 

In summary, a brain-interface guided weapon could circumvent the 
pilot’s normal volitional processing signals and rely solely on the recogni- 
tion activity, thereby making it impossible for courts to determine whether 
a volitional act occurred before weapon targeting. Alternatively, a brain- 
interface guided weapon could employ a combination of sensory recogni- 
tion of the pilot’s incipient volitional thought and probabilistic software 
calculations in such a way that a prosecutor could never definitively prove 
anything more than the most attenuated guilt for misdirected attacks on 
protected persons. 

In this context, the lack of a specific actus reus provision in the Rome 
Statute further complicates the actus reus issue.17” Although the Final Pre- 
paratory Committee had drafted a definition of actus reus, it was ultimately 
omitted from the Rome Statute,!78 because the Working Group could not 
agree on how to draft the provision in a way that imposed liability for omis- 
sions constituting a severe breach of duty but did not criminalize passivity 
to such an extent as to make it tantamount to a war crime.!”9 In a footnote 
to its report, the Working Group reserved the right to reopen the issue, 18° 
but as of yet it has not done so.!8! Because “it is not clear whether an act is 
supposed to be required as the object of criminal liability, or only as neces- 
sary condition of liability,”!®* the principle of legality may preclude a 
court from imposing one of the highest forms of criminal opprobrium on 
someone in this novel situation, especially because the individual may very 
well lack conscious control of his or her actions. 

Even if the International Criminal Court were to resolve the actus reus 
issue and a prosecutor could prove this element of the crime, a court would 
also need to find that the pilot possessed the requisite mens rea regarding 
the ends of the attack. The ICC provision defining the war crime of willful 
killing!®3 does not directly specify the criterion for determining what the 
prosecutor must prove to establish the defendant’s willfulness.18* As a 
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result, it is not clear whether the International Criminal Court will apply 
the definition specified in Article 30(2) or a narrower meaning.!®° Article 
30(2) specifies that “unless otherwise provided,” the defendant lacks crim- 
inal responsibility in the absence of proof that he or she committed the 
crime with intent and knowledge.18° Recent case law from the Interna- 
tional Criminal Tribunals has held that grave breaches of the Geneva Con- 
vention require the presence of certain types of awareness on the part of 
the actor.!87 These include actual knowledge, whether demonstrated or 
constructive,188 intent to kill or inflict grievous bodily harm,!®9 or reckless 
disregard above ordinary negligence.19° Because the ICC will apply cus- 
tomary international rules in the absence of specific provisions within the 
Rome Statute,!9! the International Committee of the Red Cross presented 
the Preparatory Commission for the International Criminal Court Working 
Group on the Elements of Crimes with an analysis of the mental state 
requirement under the Anglo-American and civil law traditions.!9? Ulti- 
mately, the Red Cross concluded that the two traditions had essentially 
similar notions of the mental state required to prove a defendant’s guilt.193 
Criminal liability attaches if either of two conditions is met. First, criminal 
liability attaches if the defendant exhibited common law intent, which is 
tantamount to dolus directus in the first or second degree under the civil 
law.194 Second, criminal liability attaches if the defendant acted with com- 
mon law recklessness, which equates to either the degree of dolus eventu- 
alis under civil law or criminal negligence, which corresponds to a lesser 
degree of dolus eventualis.!9° 


There are at least four potential problems in analyzing whether pilots 
of brain-interface guided unmanned aerial vehicles satisfy the mens rea ele- 
ment of alleged war crimes. The first two potential problems are substan- 
tive. First, just as it would be difficult to prove intent with respect to the act 
element, it may prove impossible to satisfy the necessary condition of find- 
ing that the defendant possessed a culpable state of mind in relation to the 
killing itself.1°° Second, the nature of the interface may deprive the pilot of 
the ability to make a conscious choice to refrain from the criminal act.!9” 
These issues arise for two reasons. For one, the apparent simultaneity of 
the intent, act, and belief observed in everyday actions can be divided into 


185. Id. (noting that the ICC drafters discussed the discrepancy but did not come to a 
resolution). 

186. Rome Statute, supra note 63, art. 30(2). 

187. DORMANN, supra note 4, at 41. 

188. Id. at 41 n.16. 

189. Id. at 42 n.19. 

190. Id. at 43 n.22. 

191. See Rome Statute, supra note 63, arts. 21(1)(b)-(c). 

192. ICC Report, supra note 141. 

193. Id. 

194. Id. 

195. Id. 

196. OFFICE OF THE Sec’y oF Der., supra note 57, at 65. 

197. See Stefik, supra note 53, at 692. 


2008 Brave New World 201 


discrete timeframes with this particular type of weapon.19® For another, 
the particular way that the interface operates may interrupt the conven- 
tional sequence of neurological activity that underlies volitional movement 
and the conscious intent that underlies ordinary actions.199 


The analysis of the biological process of thought and action in this 
narrow situation, however, may have much broader implications for crimi- 
nal cases. This analysis demonstrates the weaknesses of existing notions of 
criminal responsibility and requires a reassessment of their validity. In 
some of the most puzzling experiments carried out in cognitive neuros- 
cience, Benjamin Libet, a physiologist at the University of California, San 
Francisco, discovered that although the decision to act occurs about 200 
milliseconds before any volitional movement takes place, neurological 
activity precedes this decision.2© In fact, this activity occurs in the motor 
cortex 350 milliseconds before the decision to act and nearly 550 millisec- 
onds before the ultimate reaction takes place.2°! Libet performed his early 
experiments on subjects who had had electrodes implanted in their brains 
prior to brain surgery.2°2 By directly applying electricity to these elec- 
trodes, Libet could make his subjects feel various types of sensations.? 
By varying the duration of the electrical pulses, he observed that the 
patients needed about 500 milliseconds of continuous stimulation before 
they exhibited an awareness of the sensation that he aroused.2°* Further 
experiments confirmed that if patients received less than this duration of 
stimulation, they would not feel it.2°° Libet interpreted these results to 
prove that the half second of stimulation is necessary for the patient to 
achieve a conscious experience of the sensation, which Libet termed the 
“neuronal adequacy” of consciousness.*°© Upon achieving neuronal ade- 
quacy, the patient “automatically”? referred the experience “backwards 
in time”?°8 so as to create the mental narrative that he or she was aware of 
the sensation immediately after it happened.2° 


In a later experiment, reported in 1983, Libet monitored the brain 
activity of subjects who were instructed to attend to a timing device consist- 
ing of a dot of light that swept in a clockwise circle like a very fast second 
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hand.?!© Libet instructed his subjects to perform two separate actions.?!! 
First, they were told to wait for one complete revolution of the dot and then 
to flex their wrist whenever they wanted to.2!? Second, they were asked to 
associate the position of the dot with the time at which they first became 
aware of their intention to act.2!3 By measuring brain activity, Libet 
observed the sequence of events and time that elapsed between the onset of 
pre-volitional cerebral activity (termed readiness potential or RP), the deci- 
sion to act, the beginning of the movement, and the moment the subjects 
became conscious of their intent to move.?!* Although the interpretation 
of this data is subject to extensive debate because it appears to undermine 
the existence of free will,215 numerous studies, including a recent experi- 
ment using trans-cranial magnetic stimulation have confirmed these empir- 
ical results.2!© 


Some scholars have disputed the legal implications of these and other 
studies regarding the neurological basis of consciousness.”!’ For example, 
Stephen Morse argues that because criminal law is normative, i.e. the crite- 
ria that it sets for criminal responsibility exists independently from any- 
thing exogenous to law, the implications of recent scientific studies will do 
little to alter long established legal norms.?!® “Brains,” Morse asserts, “do 
not commit crimes; people commit crimes.”2!9 Given that in particular 
instances “we will virtually never have direct neuroscientific evidence con- 
temporaneous with the time of the crime . . . [, a]t most, we will have ex 
ante or ex post evidence that can produce inferences of varying validity 
about brain structure and function at the time of the crime.”2?° In the case 
of brain-interface controlled weapons, such evidence, however, most likely 
will exist. This evidence could present a severe challenge to conventional 
ideas underpinning the normative values of criminal law in both interna- 


210. Benjamin Libet et al., Time of Conscious Intention to Act in Relation to Onset of 
Cerebral Activity (Readiness-Potential): The Unconscious Initiation of a Freely Voluntary 
Act, 106 Brain 623, 624-25 (1983). 

211. Id. at 625. 

212. Id. 

213. Id. 

214. See Liset, supra note 5, at 137. 

215. See BLACKMORE, supra note 200, at 88; LiseT, supra note 5, at 144-45. 

216. Hakwan C. Lau et al., Manipulating the Experienced Onset of Intention After 
Action Execution. 19 J. of Coc. Neurosci. 81, 89 (2007). 

217. See Jeffery Rosen, The Brain on the Stand, N.Y. Times Mac., Mar. 11, 2007, at 5-6, 
9. 

218. See Stephen J. Morse, Brain Overclaim Syndrome and Criminal Responsibility: A 
Diagnostic Note, 3 Onio St. J. Crim. L. 397, 400 (2006). 

219. Id. at 397. Morse, however, does note two cases where neuroscience evidence 
may prove relevant: (1) to show “appearances are deceptive,” ie. that the defendant who 
appeared to act “consciously was in fact unconscious or in an automatic state,” and (2) 
to provide probative evidence when evidence with respect to the defendant’s behavior is 
in doubt, i.e. to show that blunt force trauma to the defendant that occurred prior to the 
crime affected his or her capacity to possess the mens rea necessary for the criminal 
charge. Id. at 400-01. 
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tional humanitarian law and domestic legal systems.?2! 


The essential problem that this type of weapon creates is that its imple- 
mentation may deprive the actor of a “veto” power over his or her action 
and thus make it impossible for him or her to exercise conscious control 
over his or her actions. Given Libet’s experimental results, neuroscientists 
and philosophers have offered several interpretations for these counterin- 
tuitive findings, the most radical being that humans lack free will.22?. If 
humans lack free will, the entire criminal law system would need reevalua- 
tion and reimplementation so as to reorient its foundation from retributiv- 
ism towards deterrence.??3 


Libet himself offers a less drastic interpretation of the findings. Libet 
conjectures that consciousness plays a role in suppressing impulses.22+ 
This view, which some have labeled “free won’t,”2?> substantially under- 
mines criminal accountability, at least in the context of alleged crimes 
committed by means of brain-machine interfaced weapon systems.?2© 
Libet notes that an interval of 100 milliseconds elapses between the time 
when neuronal activity registers a willingness to perform an act and the 
time when the primary motor cortex activates the spinal motor nerve cells 
that propagate the signal resulting in the motor act.2?’ If research con- 
firms Libet’s theory, prosecutors might not be able to prove the requisite 
mens rea to establish criminal liability for brain-interfaced drone pilots. 
The brain-interfaced machine’s design may prevent a pilot from possessing 
conscious criminal intent and may deprive the pilot of the ability to con- 
sciously refrain from carrying out the prohibited action.2?8 Recent studies 
on patients suffering from Lesch-Nyhan syndrome, which results from a 
series of genetic mutations that cause the afflicted person to lack the abil- 
ity to refrain from horrific self-mutilating behavior despite both an aware- 
ness of its destructiveness and the desire to stop, has lent additional 
credence to Libet’s claim.?29 
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The two procedural issues that arise from the use of brain-machine 
interface weapons relate to uncertainties of evidence law with regard to 
brain-scan data. Although arguably not a jus-cogens norm,??° international 
human rights’ treaties have upheld a search and seizure privacy right.*>} 
The Rome Statute arguably requires the International Criminal Court to 
recognize this privacy right.232_ The Rome Statute provides the accused the 
right “not to be compelled to testify or to confess guilt.”233 Therefore, a 
defendant probably has the right to refuse to offer self-incriminating data 
reflecting his or her brain activity at the time of the crime. A challenge to 
the admissibility of brain scans in the context of war crimes, however, will 
likely arise in the context of brain-monitored interrogations?>* before it 
arises in the context of war crimes’ prosecutions for acts involving brain- 
machine interfaced weapons. Recent developments in functional magnetic 
resonance imaging have allowed researchers to discern whether or not a 
suspect is telling the truth by observing certain types of brain activity.?3> 
Presumably, subjects accused of crimes because of incriminating brain 
scans will object to the admissibility of this type of evidence first. 

Further, rules of legal ethics may create problems.23© Although the 
International Criminal Court has yet to formalize the law governing the 
lawyers practicing before it,23”7 many American jurisdictions have profes- 
sional rules correlative to the Model Rules of Professional Responsibility 
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(Model Rules) of the American Bar Association (ABA). An American law- 
yer defending a pilot of a brain-machine interfaced UAV accused of war 
crimes would have to adhere to these rules.238 Under the Model Rules, 
lawyers have a duty of candor before the tribunal that could potentially 
disqualify many American lawyers from representing these types of 
defendants.239 

Under the Model Rules, lawyers may not knowingly “make a false 
statement of fact”2*° to the tribunal or “fail to disclose a material fact to a _ 
third person when disclosure is necessary to avoid assisting a criminal or 
fraudulent act by a client.”2*! Similarly, under the Rome Statute, a lawyer 
arguing the defendant’s innocence while in the possession of brain-scan 
data may commit an offense because making such an argument may be 
tantamount to intentionally presenting evidence that the party knows is 
false.2+2 It is unclear whether a defense lawyer privy to incriminating 
brain-scan evidence would have to disqualify himself or herself from the 
case because the evidence may so clearly amount to an indicia of guilt that 
to allege otherwise would constitute a material misstatement before the 
tribunal.2#3 Most likely, a lawyer in this situation would assert ethical pro- 
priety by first arguing that the evidence against his or her client was unreli- 
able and then asserting that criminal defendants have a right to have 
zealous representation.?** If the ethics rule precluded the defendant from 
obtaining his or her choice of counsel, however, he or she may possess a 
colorable claim that the ICC has violated his or her due process rights.2*° 


Iv. An Argument for Enlarging the Scope of Command Responsibility 


In order to vindicate the victims of alleged war crimes using brain- 
machine interfaced weapons or other autonomous weapon systems, inter- 
national humanitarian law theorists ought to reevaluate the doctrine of 
command responsibility. If theorists do not reevaluate this doctrine and 
the weapons that fall into a per se prohibition, several unsatisfactory conse- 
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quences will result. First, given that a defendant’s guilt would prove partic- 
ularly difficult to establish under the existing rubric of criminal law,?*6 
international humanitarian law would not create legal disincentives for 
pilots using such weapons to take unreasonable risks to civilian safety dur- 
ing wartime.?*” Second, international humanitarian law would create per- 
verse incentives that would encourage the development of an entire classes 
of weapons that the state could use to evade criminal penalties for even the 
most serious types of war crimes.?*8 Any principle of accountability in 
international criminal law needs to take into consideration various factors, 
including ending the victimization process, avoiding future wars, rehabili- 
tating the victims, and reconciling the members of society ravaged by con- 
flict.2#? In order to achieve these goals, international humanitarian law 
will need to attach liability for these crimes to certain classes of actors, 
without enlarging the scope of liability so far as to stigmatize them unfairly 
as war criminals.2>° 

Given that increasingly autonomous weapons may fail to discriminate 
between legitimate targets and protected persons, international humanita- 
rian law could create an outright proscription on their use. As noted in 
Part I, such a prohibition, however, might create the unintended conse- 
quence of hindering research into weapon systems that may prove more 
accurate than existing weapons. Alternatively, international humanitarian 
law could establish criminal liability for pilots of brain-machine interfaced 
UAVs or for the operators who launch “fire and forget” weapons. This 
response raises the issues outlined in Part HI. Moreover, because it is 
unlikely that the operator or actor will know the probability of error associ- 
ated with targeting these weapons, attributing guilt to them may prove diffi- 
cult given the likelihood of factors contributing to their misuse.25! As 
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complex systems rely on greater numbers of distributed components, fail- 
ures due to the complexity and tight coupling of components are statisti- 
cally assured.23? This reality provides support for aligning accountability 
for alleged war crimes committed with such weapons with higher level con- 
trol, such as that which the developers of these weapons??? and the mili- 
tary commanders that demand or sanction their use possess.25+ Criminal 
accountability based on proximity to the crime would place a dispropor- 
tionate share of responsibility on operators of weapons systems due to their 
positional role as the last actor in the sequence of events that led to the 
crimes.29° The errant bombing of civilians that brain-interfaced weapons 
produce might result from a number of plausible causes, including errors 
in the underlying algorithms of the expert systems controlling the targeting 
system, failures in sensors on remote weapons that the pilot relies upon, or 
particular genetic qualities of the operator’s brain that may cause a weapon 
to act unpredictability.2°° In any of these cases, a court would have to 
assess the validity of a superior orders’?°’ defense, requiring a complex 
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examination of the biological processes of decision-making and a difficult 
product liability analysis, all of which will do little to bring about the goals 
of rehabilitating victims and transforming society.258 International 
humanitarian law, therefore, should focus on enhancing the existing doc- 
trine of command responsibility. To make criminal accountability easier to 
determine, it should create incentives to produce maximally predictable 
and accurate weapons and to clarify the lines of authority in wartime in 
order to make criminal accountability easier to determine. 


Under existing international humanitarian law, a superior officer may 
incur criminal liability for war crimes that his or her subordinates commit- 
ted if certain conditions are met.2°9 The U.S. Supreme Court defined these 
principles in the trials of World War I] war criminals.26° In In re 
Yamashita, the Court held that commanders possess a legal duty to take 
“appropriate measures” within their power “to.control the troops under 
[their] command for the prevention of the specified acts which are viola- 
tions of the law of war.”2©1 An international tribunal delineated the scope 
of command responsibility when it held that liability will attach only on a 
showing of “personal dereliction.” Personal dereliction is either an act that 
is “directly traceable” to the actor or a criminally negligent omission by the 
actor to properly supervise his or her subordinates that amounts to “wan- 
ton, immoral disregard.”2©2 Additional Protocol I of the Geneva Conven- 
tions, which defines the law of war for international conflicts, codified the 
law of command responsibility.2© Moreover, recent international criminal 
case law has established the basis of the duty under the common law.?6* 
The International Criminal Tribunal for Yugosiavia held that for successful 
prosecution of commanders for dereliction of command responsibility by 
means of an omission pursuant to a duty to control an act committed or 
about to be committed by a subordinate, the prosecution must establish 
three elements.2®> First, it must show that the defendant was a supe- 
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rior.26© Second, it must prove that the commander knew or possessed 
information that would allow him or her to suspect that his or her subordi- 
nates were in the process of breaching or were about to breach the laws of 
war.2©7 Third, it must demonstrate that the commander did not take 
appropriate measures to prevent the criminal acts of his or her 
subordinates.2°® 


In the context of brain-machine interfaced weapons and autonomous 
weapons generally, establishing the second and third prongs would likely 
require prosecution of high-level civilian developers and officers with 
access to classified data regarding the target accuracy of such weapons and 
the known limits of their reliability. By bringing cases against designers of 
weapon systems and those who create such weapons, international human- 
itarian law would rectify some of the limitations of the existing systems of 
weapons control. Many high-level weapon designers have escaped prosecu- 
tion for design of indiscriminate or disproportionate military systems due 
to states’ reluctance to try them. No justification appears to exist for offer- 
ing amnesty to former enemies and ostensible war criminals other than 
that states have sometimes determined that gaining an important military 
advantage by acquiring pioneering technical research may outweigh 
upholding their obligations under international humanitarian law. For 
instance, after World War II, the Nazi engineer Wernher von Braun evaded 
war crimes’ charges because the United States sought his expertise in 
designing rockets that were critical for military dominance in the Cold 
War. In comparison, twenty-four defendants who had overseen the slave 
labor used to construct von Braun’s notoriously indiscriminate V-1 bombs 
and V-2 ballistic missiles and who had run its various concentration camps 
did not escape criminal punishment.*©? Similarly, the United States 
shielded from prosecution Lieutenant General Shiro Ishii, an instrumental 
figure in Japan’s development of biological warfare during World War II.27° 
American officials struck the deal with Ishii despite requests for his prose- 
cution by the Soviet Union, which had tried those who had participated in 
research into germ warfare for war crimes.?7! 

Putting engineers on notice of their potential liability may create 
incentives for them to create less indiscriminate and disproportionate 
weapons. A view of command responsibility would also create de facto 
liability for those most responsible for sanctioning the use of such weap- 
ons. International humanitarian law’s disparate treatment of actors and 
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high officials, many of whom enjoy immunity from prosecution while in 
office under long established, though increasingly challenged, prinicples of 
customary law or legislation,?’? leads to the perception that international 
humanitarian law is unfairly applied, especially as between the victors and 
the vanquished.’ By enlarging the scope of command responsibility lia- 
bility for the use of brain-machine interfaced, autonomous, or distributed 
weapons systems, international humanitarian law can ensure that advances 
in technology do not subvert its goals of minimizing collateral harm to 
non-combatants by allowing for the existence of certain types of crimes for 
which no liability would attach. 


Conclusion 


Despite the pronouncement by the International Court of Justice that 
international law has provided effective means of limiting the use of partic- 
ularly horrific or indiscriminate weapons under international law,27* the 
historical record belies such a statement. Multilateral treaties have out- 
lawed few weapons and have always done so after the weapons have proven 
outdated as a result of improvements in military technology.27> With the 
possible exception of the prohibition on blinding laser weapons,27° the 
customary law of war has not prohibited the use of weapons ex ante.277 
Although some have argued that new law is not necessary and that the 
greatest gains for international humanitarian law will occur if scholars and 
practitioners convince state parties to ratify existing treaties, the better 
view is that weapons such as neural-interfaced or autonomous drones 
represent a discrete advance in the history of warfare that will require novel 
legal instruments to regulate their development and use. 
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